Stochastic thermodynamics under coarse-graining 
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A general formulation of stochastic thermodynamics is presented for open systems exchanging 
energy and particles with multiple reservoirs. By introducing a partition in terms of "macrostates" 
(e.g. sets of "microstates" ) , the consequence on the thermodynamic description of the system is 
studied in detail. When microstates within macrostates rapidly thermalize, the entire structure 
of the microscopic theory is recovered at the macrostate level. This is not the case when these 
microstates remain out of equilibrium leading to additional contributions to the entropy balance. 
Some of our results are illustrated for a model of two coupled quantum dots. 



I. INTRODUCTION 



The last decade has witnessed major progress in 
nonequilibriuni statistical mechanics. It is becoming in- 
creasingly clear that a consistent theory of nonequilib- 
rium thermodynamics can be constructed for physical 
systems described by a stochastic Markovian dynamics. 
This so-called theory of stochastic thermodynamics gen- 
eralizes the phenomenological formulations of nonequi- 
librium thermodynamics developed for systems locally 
close to equilibrium more than half a century ago [l|-l3| . 
Early developments in this field where restricted to the 
ensemble averaged level and focused on steady state situ- 
ations 043- The crucial conceptual breakthrough came 
later and consisted in identifying the central thermody- 
namic quantities at the level of single stochastic trajec- 
tories |8|-|25| . The discovery of fluctuation theorems has 
played a major role in this regard _26 ,3^ . The second 
law of thermodynamics, traditionally expressed as an in- 
equality at the ensemble averaged level, is now under- 
stood as resulting from a universal equality at the level 
of the full probability distribution of the entropy pro- 
duction defined at the trajectory level 0, HH. These 
new theoretical developments are particularly important 
for the study of small systems subjected to sufficiently 
large and measurable fluctuations p32H34| . They coin- 
cided with an unprecedented development in the experi- 
mental techniques used to manipulate small systems and 
triggered a great deal of experimental studies in a vari- 
ety of contexts such as single molecule stretching experi- 
ments 1321 ISSl 13611 , nanomechanical oscillators work mea- 



surements [37 [^spectroscopic measurement of trajectory 
entropies [38|-|40|, and electronic current fluctuations in 
full counting statistics experiments [4l| . Since stochastic 
thermodynamics combines kinetics and thermodynamics 
it has also proved extremely useful to describe the flnite- 
time thermodynamics (e.g. efficiency at finite power) 
of various nanodevices operating as thermodynamic ma- 
chines [13-113 ■ Overall, this theory is becoming a funda- 
mental tool for the study nanosciences. 

The stochastic description underlying stochastic ther- 
modynamics relies on a time-scale separation between 
system and reservoirs. The slow degrees of freedom en- 



tering the stochastic description constitute the "system" . 
They may be controlled by an external time-dependent 
force, but are also stochastically driven by hidden degrees 
of freedom which constitute the "reservoirs" . These later 
are so fast that they can be assumed to always remain 
at equilibrium. They can thus be characterized statis- 
tically by a temperature and a chemical potential. The 
systematic procedures to perform the elimination of these 
fast degrees of freedom (starting from a Hamiltonian de- 
scription of the complete set of degrees of freedom) are 
nowadays well know |5ll - [54| . While very fast equilibrated 
degrees of freedom constituting the reservoirs are ubiq- 
uitous at small scales (without them, the very existence 
of a thermodynamic description is compromised), non- 
trivial differences may exists between system degrees of 
freedom. This is particularly true in modeling biological 
systems where each level of description hides a signifi- 
cant underlying complexity. Although some of these sys- 
tems degrees of freedom can be faster than others they 
may be maintained out-of-equilibrium thus preventing to 
treat them as reservoirs. Alternatively, one might only 
observe a subset of the true system degrees of freedom, 
since correctly identifying the system states is not always 
an easy task [55| . It is therefore important to understand 
how to formulate stochastic thermodynamics at a coarse 
grained level of description. This is the central topic of 
this paper. For convenience, we are going to call the true 
system states "microstates" and states which lump to- 
gether multiple true system states "macrostates" . While 
recent studies have investigated various aspects of such 
coarse graining at the level of the stochastic description 
[56l - l60| , as well as some of its implications at the level of 
the thermodynamics description (6ll - [63 |. the present pa- 
per analyses for the first time the effect of coarse-graining 
on stochastic thermodynamics as a whole. A rewarding 
outcome of this study is that the coarse graining pro- 
cedure a posteriori unambiguously clarifies the implicit 
assumptions made when formulating stochastic thermo- 
dynamics at the microscopic level. 

This paper is organized as follows. A general formu- 
lation of stochastic thermodynamics for open systems is 
presented in section [TTl The case of multiple reservoirs 
as well as the limit of a single reservoir is considered. 
In the later case standard equilibrium thermodynamics 
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is recovered in the reversible limit. In section IIIIl the 
coarse-graining procedure is applied to the dynamics and 
a natural approximation scheme is presented for situa- 
tions where the partition is motivated by a time scale 
separation between the micro and macro-level. In section 
rvl the effect of coarse-graining on the entropy balance 
is discussed for various scenarios. In section |Vl appli- 
cations to a double quantum dot model are presented. 
Conclusions arc drawn in section IVIl 



II. STOCHASTIC THERMODYNAMICS IN 
THE GRAND CANONICAL ENSEMBLE 

A. Multiple reservoirs 

We consider a system described by a set of states i 
with a given system energy e^, number of particles rii, 
and equilibrium entropy s^. Transitions between these 
states are induced by multiple reservoirs ly with a given 
chemical potential /i'^''^ and temperature T^"^^ . Each state 
has therefore a given grand potential (or Landau poten- 
tial) uj^'^'^ with regards to the reservoir 



(1) 



We assume that the system energy, number of particle, 
and entropy of a level i, as well as the reservoirs chem- 
ical potentials and temperatures (i.e. all terms in a;,|'^'') 
may be controlled in a time dependent manner by an 
external agent. We will refer to this process as exter- 
nal driving. Without loss of generality, we parametrized 
this time dependence through A so that w^*^' = A dxujl'^\ 
The dynamics resulting from the stochastic transitions 
between system states is ruled by the Makovian master 
equation 



Pi 



(2) 



The rate matrix, which may depend on time due to the 
external driving, satisfies Wij = and is assumed ir- 
reducible. The unique stationary distribution is thus 
obtained by solving J^j Wijpf = 0. Since transitions can 
be due to different reservoirs, the rate matrix is decom- 
posed in their respective contribution 



(3) 



Because reservoirs are assumed to always remain at equi- 
librium, the rate matrix satisfies local detailed balance 



W. 



exp 



(4) 



where fcf, is the Boltzmann constant. This property guar- 
anties that a system in contact with a single reservoir (or 



equivalently in contact with multiple reservoirs with iden- 
tical temperatures and chemical potentials) and in ab- 
sence of external driving will eventually reach the grand 
canonical equilibrium 



CO 

Pi = exp 



hT 



(5) 



This distribution satisfies the detailed balance condition 

(6) 



which defines equilibrium and indicates that all currents 
vanish in the system. 

The system energy and number of particle are natu- 
rally given by the ensemble average 



riiPi 



(7) 



However, the system entropy is not simply the ensemble 
average of the entropy of each state i but also contains 
an information (Shanon-like) contribution 



(8) 



We note that this defines entropy out-of-equilibrium. 

The change in energy and number of particle can be 
expressed as 

i? = 5^e,p, + ^e,p,=5^4^)+AaAi? (9) 

i i V 

N^Y. + E "'P* = E + ^ (^0) 

i i u 

The second contribution is due to the external driving 
while the first is due to the reservoirs and is expressed 
in terms of the energy and matter currents entering the 
system 



4^^ = E<^?'.("^--.)- 

hi 

The change in the system entropy, 

S ^^[si - kb ln.Pi]pi + E ^iPi 



(11) 
(12) 

(13) 



can be decornposed in analogy with irreversible thermo- 
dynamics as [l|, Q 

S^Si + S^. (14) 
The non-negative entropy production is given by 

S,^kbJ2w^;^p,}n-^>0. (15) 

Non- negativity is proved using In a; < x — 1. Entropy 
production only vanish for reversible transformations, i.e. 
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transformation along which the detailed balance condi- 
tion ([5]) is satisfied. The entropy flow in turn is given 
by 




1/ 



The second contribution to the entropy flow is due to 
the external driving which rcversibly modifies the equi- 
librium entropy associated to the internal structure of the 
states. The first contribution is due to the reservoirs and 
is expressed in term of the heat flowing from reservoir v 
to the system 

qM=4'')-^M/M. (17) 
As a result, work reads 

= \dxE^Y.^^'^^^M (18) 

and the first law is satisfied 

£; = yV + ^Q("). (19) 

We note that some authors do not incorporate the parti- 
cle current contribution in the definition of heat and work 
and keep it as a distinct contribution to the entropy fiow. 

B. Single reservoir 

We now show the simplifications which take place when 
the system interacts with a single reservoir (from now 
on, we stop repeating that single reservoir also refers to 
multiple reservoirs with identical thermodynamic prop- 
erties). Using with (g]), the entropy flow becomes 

T5e = ^(e, - [in,)i>, + ^ h,v^ = Q + A B^S, (20) 

i i 

where heat can be written, using p7)) . ([9]) and ((TO)) . as 

Q={E- iiN)-X{dxE- ndxN). (21) 
Using (|13p with (PH)) . entropy production now reads 

TSi = -Y,{^^ + kbT\np,)p,>Q. (22) 

i 

Introducing the system nonequilibrium grand potential 
(or Landau potential) 

n = E - iiN -TS = ^{uj^ + kbT\TLpi)p,, (23) 

i 

we find that entropy production can be expressed as 

T5i = -(f2- A5aO) > 0. (24) 



If we assume that d\ni = dxSi = as is often the case, 
we find that reduces to 

TSi = -{E -\dxE - iiN -TS) >{). (25) 

In absence of external driving, a system prepared in 
an arbitrary initial nonequilibrium state will always re- 
lax to equilibrium where all quantities stop evolving (i.e. 
5i = S'e = 5 = and f2 = i; = TV = 0). Their station- 
ary value is given by X|cq, where X = n,E,N,S and 
Icq denotes that pi is replaced by p^** given by ([5|). Note 
that using (P^ . we verify that fijoq = O'^'^. We now con- 
sider a system initially at equilibrium and subjected to 
a slow (compared to the typical relaxation time of the 
system) external driving. Its probability distribution pi 
will follow the instantaneous equilibrium grand canoni- 
cal distribution p'^'^ and the grand potential, the average 
energy and number of particles, and entropy, all become 
state functions 

A(9AX)|eq = i:|eq for X^n,E,N,S. (26) 

Such quasi-static transformations are called reversible be- 
cause entropy production remains zero all along the pro- 
cess ^ileq = 0. Consequently, the changes in the system 
entropy are given by the entropy fiow 

5|cq = ^elcq = ||cq + A {dxS)U^. (27) 

We note that in this case, we recover the fundamental 
equation of equilibrium thermodynamics from ()25|) . This 
shows how traditional equilibrium thermodynamics is re- 
covered from stochastic thermodynamics in the reversible 
limit. 

III. COARSE GRAINING 

We now define a set of "macrostates" denoted by k 
and assume that each "microstates" i leads to a unique 
macrostate k = k(i). This terminology is used for conve- 
nience and does not necessarily refer to a notion of size. 
We use the compact notation ik to denote microstates 
which lead to the macrostate k. The probability to find 
the system in a macrostate k is given by 

Pk = Y.P^^ = E '^Krl^- - kii)]p, (28) 

The conditional probability to be in the microstate 
being in the macrostate k is denoted 

P^.^P^JPk (29) 

We verify that Y.i^ = 1- 

A. Dynamics 

Writing the master equation ([2]) in terms of (|29|) . we 
find 

PkP^, + PkP^, = E ^fc' E P^.' • (30) 
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Summing this equation over ik , we find a master equation 
ruling the dynamics of the macrostates 



(31) 



This equation is not closed because the macroscopic rate 
matrix, 



V, 



kk' 



depends on the dynamics of the microstates through P^^, . 
We verify that Vkk' = 0. In general, even for a time- 
independent microscopic rate matrix, as long as the dis- 
tribution of the microlevels evolves (i.e. P^^. is time de- 
pendent), Vfcfe' will be time dependent. 



B. Time scale separation 

We now assume that the coarse graining procedure is 
chosen such that the dynamics between microstates be- 
longing to the same macrostate is much faster then be- 
tween microstates belonging to different macrostates. In 
other words, the rate matrix is such that Wi^j^. ^ Wi^j^, 
for k ^ k'. Therefore the results presented in this subsec- 
tion can be proved using perturbation theory as shown 
in appendix Rl In such situations, the conditional prob- 
abilities Pij. evolve much faster then the macrostates 
probabilities Pk- On short time scales, denoted Tmic, 
the macrostates probabilities Pk barely change while 
the Pifc's obey an almost isolated dynamics inside the 
macrostates k eventually relaxing to the stationary dis- 
tribution P^-^ defined by 



0. 



(33) 



If the transitions between microstates belonging to a 
given macrostate k are due to a single reservoir, due to 
local detailed balance property will be given by 

the equilibrium distribution 



exp 



(n'=i(fc) 



hT 



(34) 



and all currents within the macrostate vanish (i.e. de- 
tailed balance is satisfied within fc) 

W.k,kP'^^W,,,,P^. (35) 

Turning back to the general case of multiple reservoirs, 
for times much longer than Tmic, the P^-'s will start evolv- 
ing following the approximate macrostate dynamics pip 



Pk 



u.k' 



(36) 



This equation is closed because, thanks to the time scale 
separation, the exact macroscopic rate matrix can be ap- 
proximated by 



^kk' 



E w^'^' 



Jk' 



(37) 



Over a characteristic time Tmac, the P^'s will also reach 
a stationary distribution P^* defined by 



E ^kk^^^ 



v,Z' Pk' = 0. 



(38) 



If the entire system is in contact with a single reser- 
voir, the macroscopic rate matrix V^^^}^^ becomes V^^}, , 
(32) meaning that P^* is replaced by P^'^ in ([57]) . In this case. 



using (jl} and (|32|) . we recover the property of local de- 
tailed balance at the level of the macroscopic rates 



^kk' 



exp 



(n'='i(fc) - (n'='i(fc') 



(39) 



As a result, the stationary distribution of the macroscopic 

rjst 

k 



states P^' is given by the equilibrium distribution 



Pk = exp 



khT 



Using (O, dMl) and (gOl), we verify that 



cq _ poqpcq 



(40) 



(41) 



This means that over times larger than Tmac the full sys- 
tem reaches equilibrium and detailed balance condition 
(111) is satisfied. 



C. Energy and entropy 

We now turn to the effect of a general coarse-graining 
on the energy, number of particles and entropy. The 
system energy and particle number ([7]) can be expressed 
as 

E = J2mPk , N^J2^{k)Pk, (42) 

fc k 

where the average energy and number of particle condi- 
tional on being on a macrostate k are given by 



N(fc) = E"'^P^- (43) 



Their evolution can be expressed as 

E = J2 Hk)Pk + E (44) 

fc k 

iV = ^N(fc)Pfe+^N(fc)Pfc. (45) 
fc fc 

The system entropy ([8]) can be rewritten as 

5 = ^(S(fc)-fcfclnP,)Pfe, (46) 
fc 

where the entropy conditional on being on a macrostate 
k is given by 



S{k) = J2{s,,-h\nP,,] 



(47) 



ik,jk> 
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The entropy evolution reads 

^ = ^(S(fc)-fcblnPfc)Pfc+^S(fc)Pfc, (48) 



where 



5,, -fcbhlP.JP,, 



We note that the evolution of energy, number of particles, 
and entropy, expressed in terms of the macrostates [ (1441) . 
(|45|l and (|48|) ] has the same form as the original evo- 
lution expressed in terms of microstates [(O, ([TU| and 
([T^ ]. The key difference is that the evolution of the 
quantities defined on the macrostates is not anymore ex- 
clusively due to the external driving, but also contains 
the internal dynamics of the macrostate. Remarkably 
however, the form of this internal dynamics expressed in 
term of conditional probabilities, P^^. , is also the same as 
the original evolution expressed in terms of microstates. 



IV. ENTROPY BALANCE 

A. Single reservoir 

We now formulate the entropy balance for the case of 
a single reservoir. Using and in (gOl) and (PT|) . 
the entropy flow can be rewritten as 



TS,= Q + XTj2dxSik)P,, 



where heat is given by 
Q = ^(E(A;)-AiN(fc))Pfc 



(50) 



(51) 



It is worth noting that 

E(fc) - ^N(fc) - X{dxEik) - fidxi4{k)) 



(52) 



E 



fin. 



The form taken by the entropy flow at the macrostate 
level contains two types of contributions. The first is 
made of the second term of ([5(7)) and the first term of ([5T|) . 
It has the exact same form as the entropy flow at the 
microstates level ([20)1 with (|2ip . The second contribu- 
tion consists in an ensemble average over the macrostates 
probabilities, Pk, of the heat flow within each macrostate. 
We now turn to entropy production. Using the system 
entropy (|^5|) . we find that entropy production (P^ can 
be written as 

TSi = ^J2 (^(^') + hTlnPk)Pk (53) 

k 

-Y,{^(k)-Xdx(){k))Pk. 



We introduced the macrostate grand potential 

f]{k) ^ E{k) - fM{k) - TS{k) (54) 



E 



w,, +fcbTlnP,JP,,, 



(49) which is connected to the grand potential ([23)) by 



n = 



k 



{flik) + kbT\iiPk)Pk. 



(55) 



It is worth noting that 

flik) - A dxn{k) - J2 (^'^ + kbT\nP.,,)P,,. (56) 

As for the entropy flow, the form taken by the entropy 
production at the macrostate level contains two types of 
contributions. The first term in (|53p has the exact same 
form as the entropy production at the microstates level 
([m , and the second term is an ensemble average over the 
macrostates probabilities, Pk, of the entropy production 
arising from within each macrostate. 

We now turn to the situation described in IIII Bl where 
microvariables evolve faster than macrovariables. We 
consider the system evolution over timescales longer than 
■'"mic- We assume that the external driving is sufficiently 
slow to keep the microstates within macrostates at equi- 
librium, i.e. Pi^ is replaced by P^^ given by ([M)) . It can 
however be fast enough to keep the macrostate probabil- 
ities, Pk, far from equilibrium. As a result, using (|54p . 
we verify that 



n(fc)|eq = n'^'^ik) 



(57) 



where |oq means that P^^. in the expression has to be 
replaced by P°^. Defining 

X'='i(/fc) = X(/c)|oq for X = n,E,N,S, (58) 

we find the important property 

A (9aX'='1(A:) = X(A:)|cq for X = n,E,N,S, (59) 

which translates the fact that the microstates within 
macrostates evolve reversibly. As a result, using 
the system entropy evolves as 



5" = 



(S^^(fc) - kh In Pk)Pk + A ^ dxS^'^{k)Pk.m 

k 



The entropy fiow, using ([5^ with ()50p and ()5ip , becomes 
TS, = Q + xY,dxS''Hk)Pk, (61) 

k 

where heat is given by 

Q = ^(E'=''(fc)-A*N^'i(fc))Pfe. (62) 

k 

Entropy production, using ([59)) with ([53)) and ([59p , reads 
= - E (^'''(^) + kbT In Pk)Pk- (63) 

k 
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Wc notice that the second term in ([51]) as well as in 
(|53p . which both arise from the dynamics within the 
macrostatcs, have vanished due to ()59p . Using the lo- 
cal detailed balance property of the macroscopic rates 
([39)) . the entropy flow ([6T|) can finally be rewritten as 



k.k' 



^kk' - 
^k'k 



(64) 



and the entropy production (j63p as 



fc,fe' 



^k'k^k 



> 0. 



(65) 



This clearly shows that when microstates within 
macrostates are at equilibrium, stochastic thermodynam- 
ics assumes the same form at the macrostate level as at 
the microstate level. This can be clearly seen when com- 
paring (|63)) with (|22|) or ((65)) with (fTS)) as well as when 
comparing dM]) with or ([Ml) with ([H])]. This im- 
portant result demonstrates a posteriori that the theory 
of stochastic thermodynamics makes a key assumption 
at its most fundamental level of description described in 
sectionini the internal structure of the states entering the 
stochastic description may evolve due to external driving 
but always does so reversibly, i.e. by remaining at equi- 
librium. In next section, we will generalize this result to 
macrostates in contact with multiple reservoirs. 

All terms containing A vanish in absence of driving. 
However, the terms containing A at the level of the in- 
ternal dynamics of macrostates [e.g. in ([60)) and ([61]) ] 
may also be omitted for driven systems when the external 
driving can be assumed to act similarly on all microstates 
belonging to the same macrostate. 



B. Multiple reservoirs 

We now consider the general case of different reser- 
voirs. We start by separating the evolution of the system 
entropy (|46p in three contributions 



5^5(i) + 5(2) + 5(3)_ 



(66) 



The first is the evolution of the (Shannon) information 
entropy expressed in terms of the macrostates probabili- 
ties. It corresponds to the entropy evolution of a system 
made of macrostates without internal structure 



5(1) = -fc,^ A-lnPfc = ^(-fcb^PfclnPfc) 

k 



(67) 



The second contribution is an average over the ensemble 
of macrostates of the entropy change occurring within 



each macrostate 



^^'^ = E^(E^-p-+ E <Lp.. (68) 



The remaining third contribution contains the entropy 
changes due to transitions between microstates belonging 
to different macrostates 



E ^' E <L^^. 

k,k'{^k) ^v.tkJk' 



(69) 



h In P,JB 



3k' 



We note that the second and third contribution sum up 
to 



(70) 



We proceed with the entropy production (|15p which 
we also split in three parts 



S'i = 5;*^' + + 5*^' > 0. 



(71) 



The first contribution is the entropy production that 
one would write for macrostates probabilities obeying a 
closed Markovian dynamics 



■k,k' 



V^lPk 



(72) 



The second one is an ensemble average over the 
macrostates of the entropy production arising from the 
dynamics within macrostates 



In- 



(^) 



ik,jk 3k 



.(73) 



The remaining contribution can be written as 

5f^= E y^^'^'^'ki^'- (74) 

i^,k,k'{^k) 

We introduced the relative entropy 



J 3k' 



'kk 



(75) 



expressed in terms of conditional probabilities that, if a 
jump due to reservoir v occurs from k' to fc, it is a jump 
from jfe/ to ik'. 



[v) _ ik,3k' 3k' 



■< ik -3 



^kk' 



(76) 



Normalization reads f, „ — 1. This means 

^tk,3k' ■'^k,3k' 

' (3) 

that S*; can be interpreted as the entropy production 
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contribution arising from the randomness associated to 
the different ways in which a given transition between 
macrostates can occur. Using the inequahty Inx < x~l, 
we prove that D^'^^, > 0. Therefore, the three contribu- 
tions to the entropy production (|7ip are separately non- 
negative 

S^i^^ > , S'P' > , S^^^ > 0. (77) 

This leads to the important result that neglecting any of 
these contributions will always imply an underestimation 
of entropy production. We note that if only single tran- 
sitions connect pairs of macrostates via a given reservoir, 
= 1, and therefore oi",] = and 5*^^ = 0. 
We finally separate the entropy flow ([T6| as 

S-e^S-W+S-'^'+^l^). (78) 

Proceeding as before, we introduced the entropy 
flow arising from the dynamics between structure-less 
macrostates 

s'^' = -k.Y.yttip^-'^^- (79) 

u^k^k' k' k 

The entropy flow arising from the dynamics within 
macrostates is given by 

^^'^-E^^-(E-^-P- (80) 

k ^ ik 

+ E <:Lp..(^--^..-fc^i--^)) 

^i:ft.(i:.*..p...i:5;;f). 

k ^ ik V ' 

We introduced the heat conditional on being on the 
macrostate fc 

k^^\k)^\%\k)-ii^M^){k) (81) 

and the associated conditional energy and matter cur- 
rents 

Bi,^)(fc)=^w/:iP,,(£.,-e,J (82) 

ik ,jk 

ii/^(fc)-E<Lp.-=K-".-J- 

ik -jk 

The last contribution to the entropy flow arising from the 
dynamics between microstates belonging to the different 
macrostates is given by 

Si'^= E ^i^'V.' (83) 

iy,k,k'{^k) 

^i^/ifcjfc' Jik-Jk' 



It is essential to realize that the separation of the en- 
tropy balance into three contributions (the first associ- 
ated to the dynamics of structure-less macrostates, the 
second to the internal dynamics of the macrostates and 
the third to the various ways in which transitions be- 
tween macrostates can occur) is consistent in the sense 
that 

^(1) = Si'^ + si') (84) 

^(2) = + 5(2) (85) 

5(3) (86) 

We are now going to consider different limiting cases. 
We start by considering a non-driven system which has 
reached its steady state (i.e. all pi = and therefore 
Pk = as well as P^^ =0). In this case, we verify that 

5 = 5(1) =5(2) +5(3) =0 ^37^ 

Si = -5e , 5;'^' = -5^1) (88) 

5.(2) + ^.(3) = _ ^(3) (89) 

If the time-scale separation described in section IIII Bl is 
justified, the steady state macroscopic probabilities Pk 
can be approximated by P^* and the conditional proba- 
bilities Pi^ by P^* , in all the expressions obtained above. 
In the next section, we will test the validity of this result 
on a specific model system. 

We now turn to a different situation and consider a 
driven system. We assume that all transitions within a 
given macrostate k are due to a single reservoir v. We 
also assume that the driving is slower than Ty^ic, the time 
needed for P^^ to equilibrate to P^^. This means that for 
times longer than Tmic, detailed balance will be satisfied 
within macrostates ([55]). We find that 

5(2) = 5(2) = A ^ aAS"^(fc)Pfc (90) 

k 

Sl^^ = Q('') (fc) = (k) = d(';^ (fc) = (91) 

Until now, wc did not assume that the macrostates were 
thermalizing due to the same reservoirs, i.e. the P°^ could 
correspond to different temperatures or chemical poten- 
tials for different fc's. To proceed, we now do so. By 

replacing P., by P^,^ and V^J by ^i;?"^ in m and m, 
we verify that 

fik.Jk' ^ ■fjk'.ik- (92) 

This also leads to 

5p^ = Kii^""" = 0, (93) 

and as a result to 

5(3) = 5^3) ^ J2 S°^(fc)Pfe. (94) 

k 

In this case, we verify that summing up the three entropy 
contributions, we recover (|60p : 

5 = ^[S°^(fc) - kb\nPk]Pk + A^5AS<='5(fc)Pfc. 

k k 
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However, for entropy production and entropy flow we find 

iy,k,k' ^k'k -^fc 

and 

= E ^i^' (S^'^(fc) - h In ||^) (96) 

v.k.k' k' k 

which generahze (|64)) and ()65p to cases where transi- 
tions between different macrostates can be due to dif- 
ferent reservoirs. By assuming an equihbration within 
macrostates corresponding to the same reservoir (same 
temperature and chemical potential), we recovered at the 
macrostate level the most general formulation of stochas- 
tic thermodynamics presented at the microstate level in 
section |lll 



V. APPLICATION TO DOUBLE COUPLED 
DOTS 

To illustrate the different contribution to entropy pro- 
duction, we consider a model of two coupled single level 
quantum dots which was previously studied in Refs. [65l - 
1671 and which is illustrated on Fig. [TJ An electron in the 
lower dot d (resp. upper dot u) has an energy (resp. 
e„). An electron-electron interaction denoted by U takes 
place when both dots are occupied. The four microscopic 
states have no internal structure and thus no internal en- 
tropy. They are labeled by ud = 00, 10,01, 11 and have 
corresponding energies eoo = 0, eoi = e^, eio = and 
£10 = Cu+es+t/ and number of particles noo = 0, ?^ol = 1; 
7110 ~ 1 and nil = 2. The four reservoirs causing tran- 
sitions between these states arc labeled by = 1, 2, 3, 4. 
Transfers of electrons in and out of dot u (resp. d) are 
caused by reservoir 1 or 2 (resp. 3 or 4). No electron 
transfer can occur between the two dots. The rate equa- 
tion describing the full dynamics is given by 



'Pll 




"-W0141 - W^io.ii 




W^ii,oi 







'Pii 


PlO 




W^io.ii 











Pw 


Poi 




Woi,ii 











Poi 


-Poo. 







W^oo,io 




— W^oi.oo — Wiofio_ 




-Poo. 



(97) 



where the detailed form of each of the rates is given 



W^ii,oi 
W^oi.ii 
1^10,00 

W^ii,io 
1^10,11 

Woo 01 



W^l\i 
00 

wiV^o 

•^•^ 10,11 
'^*^01,00 



+ W^i^i'.^oi 
+ W^o^i'Jii 
+ W^io.oo 
+ W^o.w 
' w[tio 
<\i 
W^to 



w, 



(3) 



00,01 



W, 



(4) 



00,01 



where 
where 
where 
where 
where 
where 
where 
where 



w[V,i 

<'oo 
W^ooio 
w[%o 

•^•^ 10,11 
'^*^01,00 



W, 



(3) 



00,01 



r(i)/(i)(e„-^(7) 

rW(i-/W(e, + [/)) 
r(i)/(i)(6„) 

rW(i-/^'He.)) 
r(3)/(3)(e, + c/) 

r(3) (1-/(3) (£, + [/)) 

r(3)/(3)(6,) 

r(3)(i-/(3)(e,)) 



^•^11,01 

^•^01,11 
W(2) 
•^•^10. 00 

'^''oo.io 

<\l 

H^o^^oo 
<^oi 



r( 
r(2 
r(2 
r(2 

p(4 
p(4 
p(4 
p(4 



)(l-/(2)(6„ + ^)) 
'/(^)(£«) 



(98) 



The Fermi distributions of the reservoirs are given by 



/('^)(e) = (l + cxp 



y 



(99) 



We consider reservoirs with same temperatures but dif- 
ferent chemical potentials. We verify that the rates sat- 
isfy local detailed balance (|4]). We propose a coarse- 
graining procedure motivated by the fact that when dot 
d is faster than dot u, it can be used as a probe to detect 
the changes in the occupation of dot u [i^ [H^] . In such 
situations only the state of dot u is monitored. There- 
fore, the first macrostate, denoted uO, corresponds to 
dot u empty and contains the two microstates 00 and 
01. The second macrostate, denoted ul, corresponds to 
dot u filled and contains the two microstates 10 and 11. 
These two macrostates are represented by a square on 



fig. [T] which encapsulated the corresponding microscopic 
levels. We will only consider the steady state regime. 
We easily calculate the approximate steady-state condi- 
tional probabilities to be in a microstate corresponding 
to a given macrostate by neglecting transitions between 
macrostates 



pst 

f^lll'lll 

pst 

f^lO|iil 
pst 

•^OlIuO 
pst 

•^OOImO 



W"ii,io/(W^ii,io + 1^10,11) 
W^io,ii/(W"ii,io + 1^10,11) 
Woi,oo/(Woi,oo + Woo.Ol) 
Woo,Ol/(Woi,00 + Woo,oi)- 



(100) 
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ni 












00 











ud 



FIG. 1. Schematic illustration the coupled double dot model. 
Transitions in dot d are faster than those in dot u. The 
coarse-graining procedure consists in grouping the four "mi- 
croscopic" states ud = 00,10,01,11 into two "macroscopic 
states" uO and ul. 

Using these, we can construct the approximate rate ma- 
trix at the macrostate level 

From these we can calculate the corresponding approxi- 
mate macroscopic probabilities 

Pui = Kl,«o/(Kl,uo + KT^.ui) (102) 

^uO — ^uO,ui/(^1,mO + ^iiO,Ml)- 

Using these result, we can easily calculate the approxi- 
mate form of the different contributions to entropy pro- 
duction, S*;'^', Sf^, Sf^ presented in section HVB To 
asses the accuracy of the approximate solutions based on 
time-scale separation, we compare them with the exact 
rcsuts obtained from numerical simulation in Fig. [2] and 
Fig. [3] We always choose fcf,r = 0.1, = = = 1 
and the gate voltages as /^i + /i2 =2 and /is + /i4 = 2. 
In Fig. [21 we see that an increase in the bias inside 

■ f2) 

the macro-levels, /is — ^4, obviously increases sr' but 

leaves the macro-level entropy production, S';^'', almost 

unaffected. The converse is not true. Indeed, 5;^' is ob- 
viously affected by an increase of the bias pi\ — y^i, but 

• (2) 

S\ is also non-trivially affected. This shows that dissi- 
pation in the detector (quantum dot d) is sensible to the 
state of the detected quantum dot u, while dissipation in 
the detected dot is relatively unaffected by the presence 
of the detector. We also note that S\ always tends to 
remain relatively small. This is because transitions be- 
tween macrostates can only occur in two different ways 
in this model. We also note that the approximate so- 
lutions arc quite accurate despite a very moderate time 
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FIG. 2. (Color Online) Upper plot: Sp' and 5*^' as a function 
of the bias \},\ — fj,2 in the slow dot u, for three different values 
of the bias fia — fj,4 in the fast dot d. The full line is the 
exact result and the dotted line is the approximate solution 
based on timescale separation. Lower plot: Si (full line) and 
5.(1) + s-p) (dashed line). The difference between the full 
and dotted curve measures Fi = 1, F2 = 2, Fa = 11, 

F4 = 10. 

scale separation. For higher separation (e.g. T3 = 110, 
r4 = 100), the discrepancy is so small that it is not visi- 
ble anymore (not shown). In Fig. [31 we see that as long 
as the bias in dot u is lower than in dot d (i.e. microlevels 
are further away from equilibrium than macrolevels) , the 
approximate contributions to entropy production fit very 
well with the exact ones. However, as the bias in dot 
u becomes larger than in dot d, keeping a low discrep- 
ancy between the exact and approximate contributions 
to entropy production requires an increasing time scale 
separation between u and d. 



VI. CONCLUSIONS 

To the best of our knowledge, this paper presents the 
most complete formulation of stochastic thermodynam- 
ics. The theory is developed to describes open systems, 
in contact to multiple reservoirs, and externally driven 
by time-dependent forces. It also accounts for situa- 
tions where the system states have an internal structure 
which may be affected by the external driving. By per- 
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FIG. 3. (Color Online) On the first (resp. second and third) 
plot, the full lines from below to above (resp. from above to 
below) correspond to Fa = r4 = O.l(black), l(red), lO(blue), 
lOO(green), lOOO(pink). The dotted line is the approximate 
solution based on timescale separation, fis ~ I-I4 = 0.4 and 
Fi = F2 = 1. 



forming a coarse-graining of the system "microstates" in 
terms of "macrostates" , we analyze how the thermody- 
namic description of the system, and in particular its 
entropy balance, gets affected. We find for example that 
entropy production is made of three separately positive 
contributions. The first arises from the dynamics be- 
tween macrolevels. The second is a macrostate ensemble 
average of the entropy production arising from within 
each macrostate. The last one results from the multi- 
ple ways in which transitions between macrostates can 
occur. We also identify the precise conditions under 
which the mathematical structure of the theory at the 
microlevel is recovered after the coarse-graining proce- 
dure at the macrolcvel. This a posteriori clarifies the im- 
plicit assumptions made when describing a system using 



stochastic thermodynamics. We now repeat these cen- 
tral assumptions. Stochastic thermodynamics describes 
an open system in term of probabilities to find the system 
in certain states. These probabilities can be arbitrary 
far from equilibrium and evolve according to a Marko- 
vian stochastic dynamics. The system states may have 
an internal structure (which might even change under the 
effect of an external force) but which always remains at 
equilibrium so that a well defined energy, particle num- 
ber, and entropy, can be associated to them. Transitions 
between these states are induced by reservoirs which each 
adds an independent contribution to the rate matrix. 
These separate contributions satisfy local detailed bal- 
ance because reservoirs are sets of equilibrated degrees 
of freedom fully characterized by a temperature and a 
chemical potential. This paper shows that the internal 
consistency of stochastic thermodynamics is remarkable. 
In view of its already many successful applications, we 
are convinced that this theory will become an essential 
tool for the study of small devices operating far-from- 
equilibrium. 
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Appendix A: Justifying adiabatic elimination 

We consider a rate matrix which has a structure such 
that transitions between the microstates involving dif- 
ferent macrostates are a factor 7"^ slower than those 
involving the same macrostates: 

=<l'5.,.,+7-^<l,(l-4,.')- (Al) 
We therefore search for solutions of the form 

Pk = + 7^'^^' + l~'Pt'^ + ■■■ (A2) 

P..=C+7-^p!:'+7-^p!?+.... (A3) 

Normalization implies that X^A; ^fe°'' ^ Ylik^k^^ ~ ^ 
for n > 1, V. P'"' = 1 and V. Pf"^ = for n > 1. We 
start by using ^fcfc' — 0> which implies that Vk'k' = 
- ^k(^k') ^kk'- At order 7° and 7"^, we find 

^e^<:LpS-o (A4) 

Using dXU, dM]) and ^M^ in ^U^, we find at order 7° 

jk.i' 
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Summing (jA6p over and using (|A4p . we get that 



Summing (jA9p over and using (jA5[) . we get 



Turning back to (jA6p . we thus get 



(A7) 



(A8) 



Using (|X7)) and (|X8)) . we find that at order 7"^ ((50)) 
reads 



A-'^ p!"' + ^i"' Pf^ - i^i"^ y Wl"] P« (A9) 

ik,f 



where 



M(o) _ 



= E 



(i^) p(0) 



(All) 



Since we hmit ourself to order 7"^ and neglect order 7^^ 
and higher corrections, we can close (jA10[) by writing it 
as 



P, 



(0+1) 



r(«^)(0) p(0+l)N 



where P, 



(0+1) _ p(0) 



,(A12) 



-ip(i) 



-7-^P, 
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